THE SEMICIRCLE LAW FOR MATRICES WITH INDEPENDENT 

DIAGONALS 



OLGA FRIESEN AND MATTHIAS LOWE 

Abstract. We investigate the spectral distribution of random matrix ensembles 
f— with correlated entries. We consider symmetric matrices with real valued entries 
£N| , and stochastically independent diagonals. Along the diagonals the entries may be 

kjjy correlated. We show that under sufficiently nice moment conditions the empirical 

eigenvalue distribution converges almost surely weakly to the semi-circle law. 

< 

1. Introduction 

p/| Large-dimensional random matrices are, among others, of interest in statistics and 

PLh ■ in theoretical physics, in particular when studying the properties of atoms with 
heavy nuclei. One of the most interesting and best studied questions, has been 
to investigate the properties of the eigenvalues of random matrices. For example, 



Wigner, in his seminal paper Wig58 showed that the spectral distribution of sym- 



metric or Hermitian random matrices with independent Gaussian entries, otherwise, 
^SJ ■ under appropriate scaling converges to the semi-circle law. This was generalized by 
Arnold |Arn71] to the situation of symmetric or Hermitian random matrices filled 
with independent and identically distributed (i.i.d.) random variables with suffi- 
ciently many moments. Other generalizations of Wigner's semi-circle law concern 
matrix ensembles with entries drawn according to weighted Haar measures on clas- 
sical (e.g., orthogonal, unitary, symplectic) groups. Such results are particularly 
interesting, since such random matrices also play a major role in non-commutative 
probability (see e.g. |Gui09j ); other applications are in graph theory, combinatorics 
or algebra. 

This note addresses a question that is much in the spirit of Arnold's generalization 
of the semi-circle law. Even though a couple of random matrix models include 
situations with stochastically correlated entries (see especially |BDJ06j . where the 
case of random Toeplitz and Hankel matrices is treated), the dependencies are not 
very natural from a stochastic point of view. A generic way to construct random 
matrices with dependent entries could be to consider a two dimensional (stationary) 
random field indexed by Z, d with correlations that decay with the distance of the 
indices and to take an n x n block as entries for a random n x n matrix. 
The present note is a first step to study the asymptotic eigenvalue distribution of 
such matrix ensembles. Here we will deviate from the independence assumption 
by considering (real) random fields with entries that may be dependent on each 
diagonal, but with stochastically independent diagonals. For such matrices we will 
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prove a semi-circle law. The setup may look at first glance a bit more artificial 
than a situation where the matrices are filled with row- or columnwise independent 
random variables (e.g. with row- or columnwise independent Markov chains). Note, 
however, that in order guarantee for real eigenvalues we will need to restrict our- 
selves to symmetric random matrices. This would imply that a matrix with rowwise 
independent entries above the diagonal has columnwise independent entries below 
it. Not only is this a rather strange setup, also can one see from simulations that 
their asymptotic eigenvalue distribution is probably not the semi-circle law. 
It also should be mentioned that a similar situation has been studied by Khorun- 
zhy and Pastur in [KP94j . They consider the eigenvalue distribution of so called 
deformed Wigner ensembles that consist of matrices which can be written as a sum 
of Wigner matrix (a symmetric matrix with independent entries above the diago- 
nal) and a deterministic matrix. It is proven that in this situation the empirical 
eigenvalue density converges in probability to a non-random limit. This setup, yet 
similar, is different from ours. 

The rest of the note is organized as follows. In the second section we will formalize 
the situation we want to consider and state our main result. Section 3 is devoted to 
the proof, that is based on a moment method. Section 4 contains some examples. 



2. Main Results 

In this section we will state our main theorem, a semi-circle law for symmetric 
random matrices with independent diagonals (for a precise formulation see Theorem 
l2.1l below). The limit law for their empirical eigenvalue distribution is the semi-circle 
distribution. Its density is given by 



f V4 - x 2 if - 2 < x < 2 
otherwise. 



We want to consider the following setup: Let {a(p, q), 1 < p < q < oo} be a real 
valued random field. For any neN, define the symmetric random nxn matrix X„ 
by 

X n (q,p) = X n (p,q) = -=a(p,q), 1 < p < q < n, 

>n 



We will have to impose the following conditions on X r 



(CI) E [o(p, q)\ = 0, E [a(p, q) 2 } = 1 and 



rrik := sup max E 



\a(p,q)\ l 



< oo, k e N. 



(C2) the diagonals of X n , i.e. the families {a(p,p + r),p e N}, r e N , are inde- 
pendent, 

(C3) the covariance of two entries on the same diagonal depends only on their 
distance, i.e. for any r e No we can define 

Cov(r) := Cov(a(p, g), a(p + r, q + r)), p, q E N, 
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(C4) the entries on the diagonals have a quickly decaying dependency structure, 
which will be expressed in terms of the condition 



T=0 



OV T < OO. 



We will denote the (real) eigenvalues of X n by A^ < Ag < . . . An. Let \i n be the 
empirical eigenvalue distribution, i.e. 



1 n 



fl n — — > C).(n). 

fe=i 

With these notations we are able to formulate the central result of this note. 

Theorem 2.1. Assume that the symmetric random matrix X n as defined above 
satisfies the conditions (CI), (C2), (C3) and ((74). Then, with probability 1, the 
empirical spectral distribution of X n converges weakly to the standard semi-circle 
distribution, i.e. 

/j< n =>• /i as n oo 
both, in expectation and P — almost surely. Here "=> " denotes weak convergence. 

Remark 2.2. Note that in order for the semi-circle law to hold, it is not possible to 
renounce condition (C4) without any replacement. Consider for example a Toeplitz 
matrix, that is a Hermitian matrix with identical entries on each diagonal. For such 
a matrix, we clearly have 



£|Co V (, 



[T)\=00. 

T = 

Indeed, it was shown in [BDJ06] that the empirical distribution of a sequence of 
Toeplitz matrices tends with probability 1 to a nonrandom probability measure 
with unbounded support. 

3. Proof of Theorem 12.11 

We want to resort to the method of moments to prove Theorem 12.11 (this method 
has been applied in similar situations in |Arn71] or |SSB07] , among (many) others). 



To this end, let Y be distributed according to the semi-circle distribution. For the 
proof of the theorem it will be important to notice that the moments of Y are given 
by 

. I 0, if is odd, 

I Cfe, it k is even, 

where Ck = -r-M — r- denote the Catalan numbers. Since these moments determine 

2 |!(|+l)! 

the semicircle distribution uniquely, the weak convergence of the expected empirical 
distribution will follow from the relation 

1 r / »im I 0, if k is odd, 
lim — E tr X*) = {' 
n->oo n I Ck, it k is even, 
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where tr(-) denotes the trace operator. The first part of the proof is to verify this 
convergence. 

To start with, consider the set T n {k) of A;-tuples of consistent pairs, that is elements 
of the form (Pi, . . . , Pk) with Pj = (pj, qj) G {1, . . . , n} 2 satisfying qj = pj + i for any 
j — 1, . . . , k, where k + 1 is identified with 1. Then, we have 

^E[tr(X^)]=^ r Y, E \a{Pi) • . . . • a(P k )} . 
n (Pi,...,P k )eTn(k) 

Further, define V(k) to be the set of all partitions n of {1, . . . , k}. Any partition 7r 
induces an equivalence relation ~ 7r on {1, . . . , k} by 

i ~tt j : < ^=r- i and j belong to the same set of the partition ir. 

We say that an element (Pi, . . . , P k ) G T n {k) is a n consistent sequence if 

\Pi - Qi\ = \Pj - Qj\ i~nj- 

Due to condition (C2), this implies that a(Pj 1 ),..., a(Pj ; ) are stochastically inde- 
pendent if ii, . . . ,ii belong to / different blocks of it. The set of all n consistent 
sequences (Pi, . . . , Pk) G T n {k) is denoted by S n (ir). Thus, we can write 

1e [tr (x*)] = E E E [°(^) • • • • • ■ 

n 2 TreV(k) (P 1 ,...,P k )eS n (n) 

Now fix a k G N. For any n G let #7r denote the number of equivalence classes 
of 7r. We distinguish different cases. 

First case: #7r > | 

Since it is a partition of {1, . . . , k}, there is at least one equivalence class with a 
single element /. Consequently, for any sequence (Pi, . . . , Pk) G S n (ir) we have 

E [a(P0 • . . . • a(P fc )] = E [ J] a(P)] • E [a(P)] = 0, 

due to the independence of elements in different equivalence classes. 
Hence, we obtain 

[tr (XJ|)] = ^ Y, E E[a(P 1 ).....a(ft)]. 

TrGP(fe), (Pi,...,P fc )6S„(7r) 



Second case: r := #7r < 



We need to calculate #S n (n). To fix an element (Pi,...,P fc ) G S n (ir), we first 
choose the pair P x = (pi,qi). There are at most n possibilities to assign a value to 
Pi and another n possibilities for q\. To fix P2 = (^2,^2), note that the consistency 
of the pairs implies P2 = qi- If now 1 ~„- 2, the condition \pi — qi\ = \p2 — 92 1 allows 
at most two choices for q 2 . Otherwise, if 1 ^ n 2, we have at most n possibilities. 
We now proceed sequentially to determine the remaining pairs. When arriving at 
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some index i, we check whether i is equivalent to any preceding index 1, . . . ,i — 1. 
If this is the case, then we have at most two choices for Pj and otherwise, we have 
n. Since there are exactly r different equivalence classes, we can conclude that 

l k - r < C ■ n r+1 



#S n (n) < n 



2 /- 1 



with a constant C = C(r, k) depending on r and k. 

Now the uniform boundedness of the moments and the Holder inequality together 
imply that for any sequence (Pi, . . . , P&), 



\E[a(P 1 )-...-a(P k ))\ < E|a(Pi) 



E\a(P k ) 



< m k . 



(3.2) 



Consequently, taking account of the relation r < |, we get 



1 



i+- 
n 2 



E 



E 

TreV(k), (Pi,...,P fc )6S„(7r) 



|E [a (Pi 



a(P k )]\<C- 



i+- 
n ^2 



n 



r+1 



0(1). 



Combining the calculations in the first and the second case, we can conclude that 
lim -E [tr (X*)] = lim * £ £ E [aft) • . . . • a(P fc )] , 



71 n-5-oo „it2 

TreP(fc), (P 1 ,...,P k )eS„(7r) 



-U-„— k 



if the limits exist. 



Now consider the case where k is odd. Since then the condition #7r = | cannot be 
satisfied, the considerations above immediately yield 

lim -E [tr (X k n )] = 0. 



It remains to cope with even k. Denote by VV(k) C V(k) the set of all pair parti- 
tions of {1, ... , k}. In particular, j^ix = | for any n G W(k). On the other hand, if 
#7r = | but 7r ^ VV(k), we can conclude that 7r has at least one equivalence class 
with a single element and hence, as in the first case, the expectation corresponding 
to the 7r consistent sequences will become zero. Consequently, 

lim -E [tr (X*)] = lim -L £ £ E [a(P0 • . . . • a{P k )\ , 

■nevv(k) (P 1 ,...,p k )es n (Tr) 

if the limits exist. We have now reduced the original set V(k) to the subset VV(k). 
Next we want to fix a tt G VV(k) and cope with the set S n (ir). 

Lemma 3.1 (cf. |BDJ06] . Proposition 4.4.). Let S*(ir) C SV^) denote the set of n 
consistent sequences (Pi, . . . , P^) satisfying 



i^-K 3 ft - Pi = Pi - 9j 
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for all i 7^ j. Then, we have 

# (S n (n)\S:(n)) = o (n 1+ t) . 

Proof. We call a pair {P i} Pj) with i ~„- j, i ^ j, positive if qi—pi = qj —pj>0 and 
negative if qi—pi = qj — pj < 0. Since J2i=i % — Pi = by consistency, the existence 
of a negative pair implies the existence of a positive one. Thus, we can assume that 
any sequence (Pi, . . . , P k ) G S n (ir)\S*(7r) contains a positive pair (Pi,P m ). To fix 
such a sequence, we first determine the positions of I and m and then, we fix the 
signs of the remaining differences q%—pi. The number of possibilities to accomplish 
that depends only on k and not on n. Now we choose one of n possible values for 
p\. In a next step, we fix the values of the differences \qi — p%\ for all Pi except for P\ 
and P m . Since in each case two pairs are equivalent, i.e. the difference of the indices 
is equal, we have n" 1 possibilities for that. Then, ^i=i <?i — Pi = implies that 

k 

< 2(qi - pi) = qi - pi + q m ~ Pm = /.Pi- Qi- 

i=\, 

Since we have already chosen the signs of the differences as well as their absolute 
values, we know the value of the sum on the right hand side. Hence, the difference 
qi — pi = q m — p m is fixed. We now have the index p h all differences |<& — Pi\ , i G 
{1, . . . , k}, and their signs. Thus, we can start at Pi and go systematically through 
the whole sequence (Pi, . . . , P&) to see that it is uniquely determined. Consequently, 
our considerations lead to 

# (S n (n)\S:(n)) < C ■ J = o . 

□ 

As a consequence of Lemma [3. II and relation (13. 2p . we obtain 

lim — E [tr (3*)] = lim JL £ £ E [a{P x ) • . . . • a(P k )] , 

neTVik) (Pi,...,P k )eS*(n) 

if the limits exist. 

We call a pair partition ir G VV(k) crossing if there are indices i < j < I < m with 
i ~ 7r / and j ~ n m. Otherwise, we call n non-crossing. The set of all non-crossing 
pair partitions is denoted by J\fVV(k). 

Lemma 3.2. For any crossing it G VV(k)\AfVV(k) , we have 

E[a(P 1 )-...-a(P k )} = o(n^ +i y 

(p 1 ,...,p k )es*{-K) 
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Proof. Let ir be crossing and consider a sequence (Pi, . . . , P k ) G S^(n). Note that 
if there is an I G {1, . . . , k} with / ~„- I + 1, where k + 1 is identified with 1, we 
immediately have 

a(P,) = a(P,+i), 

since = by consistency and then = qi + \ by definition of S^(7r). In particular, 

E[a(P l )-a(P l+1 )] = l. 

The sequence (Pi, ... , P_i, P+2, • • • , Pk) is still consistent because of the relation 
qi-i — pi — qi + i = pi+2- Since there are at most n choices for qi = pi+i, it follows 

#S* n (n)<n-#S* n (7rU), 

where n w G VV(k - 2)\MVV(k - 2) is the pair partition induced by ir after 
eliminating the indices / and I + 1. Let r denote the maximum number of pairs of 
indices that can be eliminated in this way. Since n is crossing, there are at least two 
pairs left and hence, r < | — 2. By induction, we conclude that 

#S:(n)<n r .#S* n (n^), 

where now ir^ G W(k—2r)\AfVV(k—2r) is the still crossing pair partition induced 
by 7r. Thus, we so far have 



|E [a(Pi) • . . . • a(P k 

(P 1 ,...,P k )eS*(n) 



(p 1 W 1 ...,pW 2r )es;( w W) 



(3-3) 



Choose % ~„-(r) % + j such that j is minimal. We want to count the number of 
sequences (Pi^, . . . , Pk-2r) ^ ^n( rr ^) given that p^p and are fixed. Therefore, 
we start with choosing one of n possible values for q^ . But then, we can also deduce 
the value of 



(r) (r) (r) (r) 

Pi+j = q\ -p\ 

Since j is minimal, any element in {i + 1, . . . , % + j — 1} is equivalent to some ele- 
ment outside the set {i, . . . , % + j}. There are n possibilities to fix P^ as = q^ 
is already fixed. Proceeding sequentially, we have n possibilities for the choice of 
any pair P^ with I G {i + 2, . . . , i + j — 2} and there is only one choice for P/+j_i 

since <?i+.,_i = pj+j is already chosen. For any other pair that has not yet been fixed, 
there are at most n possibilities if it is not equivalent to one pair that has already 
been chosen. Otherwise, there is only one possibility. Hence, assuming that the 
elements p[ r ^ and qf^ are fixed, we have at most 
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possibilities to choose the rest of the sequence (P^ , . . . , P k } 2r ) £ ^^(ir^). Conse- 
quently, estimating the term in (13. 3 p further, we obtain 

n 

£ \E[a(P l ).....a(P k )}\<n^ £ |Cov(|g« - >|)| 

(P 1 ,...,P k )eS*(n) M (r) 

n-1 

< C-nt^|Cov(r)| = o(n 1+ *), 

r=0 

since |Cov(r)| < oo by condition (C4). 

Lemma 13.21 now guarantees that we need to consider only non-crossing pair parti- 
tions, that is 

lim -E [tr (Xj)] = lim JL £ £ E [a(P x ) • . . . • a(P fe )] , 

neAfVV{k) (Pi,...,P fc )e5*(7r) 

if the limits exist. 

Lemma 3.3. Let tt G AfVV(k). For any (Pi, ...,P k )e S*(ir), we have 

E [a(Pa) • . . . • a(P & )] = 1. 

Proof. Let / < m with m ~,r /. Since tt is non-crossing, the number I — m — 1 of 
elements between Z and m must be even. In particular, there is I < i < j < m 
with i ~ 7r j and j = i + 1. By the properties of £*, we have a(Pj) = a(Pj), and 
the sequence (Pi, . . . , Pi, . . . , Pj_i, Pj+2, • • • , Pm, ■ ■ ■ , -Ffc) is still consistent. Applying 
this argument successively, all pairs between I and m vanish and we see that the 
sequence (Pi, . . . , P/, P m , . . . , P k ) is consistent, that is qi — p m . Then, the identity 
Pi = q m also holds. In particular, a(P ; ) = a(P m ). Since I, m have been chosen 
arbitrarily, we obtain 

E [a(Pi) ■ . . . ■ a(P k )] = E H P <) • a ( P -)] = L 

I <m 

□ 

It remains to verify 

Lemma 3.4. For any n G MVV{k), we have 

ln„*$M = l. 

n— ¥oo ^"2+1 

Proof. To calculate the number of elements in S*(tt), first choose Pi. There are n 2 
possibilities for that choice. If 1 ~ 7r 2, then P 2 is uniquely determined since p 2 = qi 
and by definition of S*(tt), q 2 = p\. If 1 7^ 2, then there are n— \ possibilities to fix 
Pi. Proceeding in the same way, we see that if % G {2, . . . , k} is equivalent to some 
element in {1, . . . ,i — 1}, there is always only one value Pj can take. Otherwise 
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there are asymptotically n choices. The latter case will occur exactly | — 1 times. 
In conclusion, 



k 



□ 



Lemma [3.31 and Lemma [3.41 now provide that 



lim -E[tr(X*)] = lim * 



E E • • • • • 

7reMvp(k) (P u ...,p h )es*(7r) 

J2 #S* n (n) = #NVV(k). 



= lim k - 

n—^oo ^l+"5 

Since the number of non-crossing pair partitions #AfVV(k) equals exactly the Cata- 
lan number Ck, we can conclude that the expected empirical spectral distribution 

2 

of X n tends to the semi-circle law. This is the asserted convergence in expectation. 

It remains to deduce almost sure convergence. Therefore, we want to follow the 
ideas of [BDJ06J. To this end, we need 

Lemma 3.5. Suppose the conditions of Theorem \2.1\ hold. Then, for any fc,n6N, 



E 



(tr(j£)-E[tr (**)])' 



<C-n 2 . 



Proof. Fix fc,?i£N. Using the notation 

P = (P 1; . . . , P k ) = ((pi, qi ), . . . , (p k , q h )), a(P) = a{P l ) a(P k ), 
we have that 



E 



(tr(Xi)-E[tr(Xi)]) 4 ' 



n 



2k 



E 



e E fn ( a ( p0) ) - e K p(j) )]) i • (3-4) 



7r( 1 ),...,7r(4)e-P(fe) PWe5„(7rW),i=l,...,4 i= l 



Now consider a partition n of {1, ... , 4k}. We say that a sequence 
is 7r consistent if each pW, i = 1, . . . , 4, is a consistent sequence and 



I W (*)| 

5t — Pi 



_ n 0')| 

"m Pm 



Z + (i - l)k ~ n m + (j - l)k. 

Let <S n (7r) denote the set of all 7r consistent sequences with entries in {1, . . . , n}. 
Then, (13.41) becomes 



E 



(trX^-E[trX3) 4 
1 



n 



2k 



E E E\H(a(pV)-E[a(P<»)])]. (3.5) 



7rgP(4fc) (P(i),...,P(4))e5„(7r) J=l 
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We want to analyze the expectation on the right hand side. Therefore, fix a tt 6 
V(4:k). We call 7r a matched partition if 

(i) any equivalence class of 7r contains at least two elements and 

(ii) for any i G {1, . . . , 4} there is a j ^ i and I, m G {1, . . . , k} with 

l + (i-l)k ~ w m + (j-l)k. 
In case 7r is not matched, we can conclude that 



0. 



e E[n(^ (j) )- E K^)]) 

(P( 1 ),...,P( 4 ))g5„(7T) J = l 

Thus, we only have to consider matched partitions to evaluate the sum in ( 13. 51) . Let 
7r be such a partition and denote by r = the number of equivalence classes of 
7r. Note that condition (i) implies r < 2k. To count all 7r consistent sequences 
(P^, P< 4 )), we first choose one of at most n r possibilities to fix the r different 
equivalence classes. Afterwards, we fix the elements p^ , . . . , p± , which can be done 
in n 4 ways. Since now the differences \q\ — p\ \ are uniquely determined by the 
choice of the corresponding equivalence classes, we can proceed sequentially to see 
that there are at most two choices left for any pair P^K To sum up, we have at 
most 

2 4k ■ n 4 ■ n r = C ■ n r+4 
possibilities to choose (P^\ . . . , P^). If now r < 2k — 2, we can conclude that 

#S n {<*) <C-n 2k+2 . (3.6) 

Hence, it remains to consider the case where r = 2k — 1 and r = 2k, respectively. 

To begin with, let r — 2k — 1. Then, we have either two equivalence classes with 
three elements or one equivalence class with four. Since 7r is matched, there must 
exist an % G {1, ... ,4} and an / G {1, . . . , k} such that is not equivalent to 
any other pair in the sequence PW . Without loss of generality, we can assume that 
i — 1. In contrast to the construction of (P^\ . . . , P^) as above, we now alter 
our procedure as follows: We fix all equivalence classes except of that P/ 1 ^ belongs 
to. There are n r ~ l possibilities to accomplish that. Now we choose again one of n 4 
possible values for p{ \ . . . ,p^. Hereafter, we fix qm, m — 1, ... ,1 — 1, and then 
start from q£' = p^ to go backwards and obtain the values of pjP , . . . ,Pi\- Each 
of these steps leaves at most two choices to us, that is 2 k ~ 1 choices in total. But 
now, P^ is uniquely determined since p\^ = qj^ t and = p^ by consistency. 
Thus, we had to make one choice less than before, implying (13.61) . 

Now, let r = 2k. In this case, each equivalence class has exactly two elements. Since 
we consider a matched partition, we can find here as well an I G {1, . . . , k} such 
that Pj is not equivalent to any other pair in the sequence P^\ But in addition 
to that, we also have an m G {1, . . . , A;} such that, possibly after relabeling, Pm is 
neither equivalent to any element in P^ nor to any other element in p( 2 \ Thus, 
we can use the same argument as before to see that this time, we can reduce the 
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number of choices to at most C ■ n r+2 = C ■ n 2k+2 . In conclusion, (13. 6 j) holds for any 
matched partition 7r. To sum up our results, we obtain that 



E 



(trX*-E[trXgy 

= - V 



E E\H(a(pM)-E[a(P^)]) 



<C-n 2 



(P( 1 ),...,P( 4 ))e5„(7r) 3=1 

7T matched 



which is the statement of Lemma OL 



□ 



From Lemma 13.51 and Chebyshev's inequality, we can now conclude that for any 
e > and any k, n G N, 



P 



-trXi - E 



?? 



1 



trX 



>e < 



C 



Hence, the convergence in expectation part of Theorem 12.11 together with the Borel- 
Cantelli lemma yield that 



lim -trXj? 



E [Y k ] almost surely, 



where Y is distributed according to the standard semi-circle law. In particular, we 
have that, with probability 1, the empirical spectral distribution of X n converges 
weakly to the semi-circle law. 



4. Examples 

4.1. Gaussian processes. Let {a(p,p + r),p G N}, r G No, be independent fami- 
lies of stationary Gaussian Markov processes with mean and variance 1. In ad- 
dition to this, we assume that the processes are non-degenerate in the sense that 
E [a(p,p + r)\a(q, q + r),q < p — 1] ^ a(p,p+r). In this case, the conditions of The- 
orem 12.11 are satisfied. Indeed, for fixed r G N and any p G N, we can represent 
a p := a(p,p + r) as 

p 

a p = x p y&ii 

3=1 

where is a family of independent standard Gaussian variables and x p ,yi, . . . ,y p G 
M\ {0}. Then, we obtain 

Cov(r) = Cov(a p ,a p+T ) = 

Xp 

implying Cov(r) = Cov(l) r for any r G No- By calculating the second moment 
of a 2 = X2V2^2 + Cov(l)ai, we can conclude that |Cov(l)| < 1. Thus, we have 
Er=olCov(r)|<oo. 
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4.2. Markov chains with finite state space. We want to verify that condition 
(C4) holds for stationary TV-state Markov chains which are ergodic and reversible. 
Let {Xj,, k G N} be such a Markov chain with mean and variance 1. Denote by 
P the corresponding N x N transition matrix and by ir its stationary distribution. 
Reversibility yields that P is diagonalizable. Hence, for any k G N, we can write 

pk _ rpj^krp — 1 

for some invertible matrix T and a diagonal matrix D = diag(Ai, . . . , Xn)- Denoting 
by si, . . . , sjv the N possible states of the chain, we get 

N N / N N \ 

Cov(X n ,X n+k ) = s iSj ir(i)P%j) ^Yxn^s^TiiJ^SjT-'ilJ) . 

i,j=l 1=1 \i=l j=l J 

Since P is stochastic, we have |Aj| < 1 for any I — 1, . . . , N. If |Aj| = 1, ergodicity 
implies that Xi = 1. The corresponding space of right eigenvectors is spanned by 
the vector v — (1, . . . , 1) T . Consequently, 

N 

J2 Si ir(i)T(i,l) = cE[Xi] = 0. 
i=i 

Thus Cov(X n ,X n+fc ) decays exponentially to as k — > oo and condition (C4) is 
satisfied. 
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